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PROTOCOL  FOR  EQUIPMENT  VERIFICATION 
TESTING  FOR  ARSENIC  REMOVAL 


1.0  INTRODUCTION 

This  document  is  the  study  protocol  to  be  used  for  verification  testing  of  equipment  designed  to 
achieve  arsenic  removal.  In  order  to  participate  in  the  equipment  verification  process,  the 
equipment  Manufacturer  is  requested  to  adhere  to  the  requirements  of  this  study  protocol  in 
developing  a  Manufacturer  Field  Operations  Document.  The  final  submission  of  the 
Manufacturer  Field  Operations  Document  shall: 


•  include  the  information  requested  in  this  protocol; 

•  conform  to  the  format  identified  herein; 

•  and  conform  to  the  specific  NSF  International  (NSF)  Equipment  Verification 
Testing  Plan  or  Plans  related  to  the  statement(s)  of  capabilities  that  are  to  be 
verified. 

The  Manufacturer  Field  Operations  Document  may  include  more  than  one  Testing  Plan.  For 
example,  testing  might  be  undertaken  to  verify  performance  of  a  package  plant  employing 
coagulation  and  filtration  for  arsenic  removal  and  for  removal  of  microbiological  and  particulate 
contaminants  or  for  removal  of  disinfection  byproduct  precursors. 

This  protocol  document  is  presented  in  two  fonts.  The  non-itelicized  font  provides  backgroimd 
information  that  the  Manufacturer  may  find  useful  in  preparation  of  the  Manufacturer  Field 
Operations  Document.  The  italicized  text  indicates  specific  study  protocol  deliverables  that  are 
required  of  the  Manufacturer  and  that  must  be  incorporated  in  the  Manufacturer  Field 
Operations  Document. 

The  following  glossary  terms  are  presented  here  for  subsequent  reference  in  this  protocol: 

•  Certification  -  the  attestation  that  an  equipment  and/or  a  device  met  all  applicable 
requirements,  e.g.,  standard,  performance  criteria  and  policies,  and  continues  to  meet  all 
applicable  requirements. 

•  Distribution  System  -  a  system  of  conduits  by  which  a  primary  water  supply  is  conveyed  to 
consumers  typically  by  a  network  of  pipes 
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•  Manufacturer  -  is  a  business  that  assembles  and/or  sells  package  plant  equipment  and/or 
modular  systems.  The  role  of  the  manufacturer  is  to  provide  the  package  plant  and/or 
modular  system  and  technical  support  for  the  verification  testing  and  study.  The  manufacturer 
is  also  responsible  for  providing  assistance  to  the  testing  organization  during  operation  and 
monitoring  of  the  package  plant  or  modular  system  during  the  verification  testing  and  study. 

•  Manufacturer  Field  Operations  Document  -  document  of  field  testing  operations  and 
procedures.  Document  will  be  prepared  by  Manufacturer  or  by  third  party  on  behalf  of 
Manufacturer  and  will  include  the  specific  details  of  the  experimental  approach  in  the  section 
titled  Field  Operations  Procedures. 

•  Modular  System  -  a  packaged  fimctional  assembly  of  components  for  use  in  a  drinking  water 
treatment  system  or  package  plant  that  provides  a  limited  form  of  treatment  of  the  feed 
water(s)  and  which  is  discharged  to  another  module  of  the  package  plant  or  the  final  step  of 
treatment  to  the  distribution  system. 

•  NSF  Equipment  Verification  Testing  Plan  -  specific  testing  plan  for  each  technology 
application,  such  as  reverse  osmosis  package  plants  or  coagulation  and  filtration  package 
plants.  This  plan  will  be  developed  by  NSF  for  Manufacturer  to  assist  in  development  of 
Manufacturer  Field  Operations  Document. 

•  Plant  Operator  -  the  person  working  for  a  small  water  system  who  is  responsible  for  operating 
package  water  treatment  equipment  to  produce  treated  drinking  water.  This  person  also  may 
collect  samples,  record  data,  and  attend  to  the  daily  operations  of  equipment  throughout  the 
testing  periods. 

•  Package  Plant  -  a  complete  water  treatment  system  including  all  components  firom  connection 
to  the  feed  water(s)  through  discharge  to  the  distribution  system 

•  Study  Protocol  for  Equipment  Verification  Testing-  this  document.  Protocol  will  be  used  for 
reference  dixring  Manufacturer  participation  in  verification  testing  program; 

•  Testing  Organization  -  an  organization  qualified  to  perform  studies  and  testing  of  package 
plants  or  modular  systems.  The  role  of  the  testing  organization  is  to  ensure  that  there  is 
skilled  operation  of  a  package  plant  during  the  intense  periods  of  testing  during  the  study  and 
the  tasks  required  by  the  Study  Protocol  for  Equipment  Verification  Testing  are  performed. 
The  Testing  Organization  is  responsible  for: 
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►  managing,  evaluating,  interpreting,  and  reporting  on  the  data  produced  by  the  verification 
testing  and  study; 

►  providing  logistical  support,  scheduling,  and  coordinating  the  activities,  e.g.,  establishing  a 
communications  network,  of  all  participants  in  the  verification  testing  and  study; 

►  ensuring  that  the  locations  selected  for  the  testing  and  study  have  feed  water  quality 
consistent  with  the  objectives  of  the  Study  Protocol  for  Equipment  Verification  Testing. 

•  Verification  -  to  establish  the  evidence  on  the  range  of  performance  of  equipment  and/or 
device  under  specific  conditions  following  a  predetermined  study  protocol. 

•  Water  System  -  the  water  system  that  operates  package  water  treatment  equipment  to  provide 
treated  water  to  its  customers. 

1.1  Background 

U.S.  Environmental  Protection  Agency  (EPA)  has  partnered  with  NSF,  a  nonprofit  testing  and 
certification  organization,  to  verify  performance  of  small  package  drinking  water  systems  that 
serve  small  communities.  It  is  expected  that  both  the  domestic  and  international  markets  for  such 
systems  are  substantial.  EPA  and  NSF  have  formed  an  oversight  stakeholders  group  composed  of 
buyers,  sellers,  and  state  permitters,  to  assist  in  formulating  consensus  testing  protocols.  A  goal 
of  verification  testing  is  to  enhance  and  facilitate  the  acceptance  of  small  package  drinking  water 
treatment  equipment  by  state  drinking  water  regulatory  engineers  and  consulting  engineers  while 
reducing  the  need  for  testing  of  equipment  at  each  location  where  the  equipment  use  is 
contemplated. 

NSF  will  meet  this  goal  by  working  with  equipment  Manufacturers  and  other  agencies  in  planning 
and  conducting  equipment  verification  testing,  evaluating  data  generated  by  such  testing  and 
managing  and  disseminating  information.  The  Manufacturer  is  expected  to  secure  the  appropriate 
resources  to  support  their  part  of  the  equipment  verification  process,  including  provision  of 
equipment  and  technical  support. 

The  verification  process  established  by  EPA  and  NSF  is  intended  to  serve  as  a  template  for 
conducting  water  treatment  verification  tests  that  will  generate  high  quality  data  for  verification  of 
equipment  performance.  The  verification  process  is  a  model  process  that  can  help  in  moving 
small  package  drinking  water  equipment  into  routine  use  more  quickly.  The  verification  of  an 
equipment's  performance  involves  five  sequential  steps  : 

1 .  Development  of  a  Verification/Manufacturer  Field  Operations  Document; 

2.  Execution  of  verification  testing; 
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3 .  Data  reduction,  analysis,  and  reporting; 

4.  Performance  and  cost  (labor,  chemicals,  energy)  verification; 

5 .  Report  preparation  and  information  transfer. 

1.2  Objectives 

The  specific  objectives  of  the  equipment  verification  testing  may  be  different  for  each 
Manufacturer,  depending  upon  the  statement  of  capabilities  of  the  specific  equipment  to  be  tested. 
The  objectives  developed  by  each  Manufacturer  will  be  defined  and  described  in  detail  in  the 
Manufacturer  Field  Operations  Document  developed  for  each  piece  of  equipment.  The  objectives 
of  the  equipment  verification  testing  may  include: 

•  Generating  field  data  appropriate  for  verifying  the  performance  of  the  equipment; 

•  Generating  field  data  in  support  of  meeting  current  or  anticipated  water  quality 
regulations; 

•  Evaluating  new  advances  in  equipment  and  equipment  design. 

An  important  aspect  in  the  development  of  the  verification  testing  is  to  describe  the  procedures 
that  will  be  used  to  verify  the  statement  of  performance  capabilities  made  for  water  treatment 
equipment.  A  verification  testing  plan  document  incorporates  the  QA/QC  elements  needed  to 
provide  data  of  appropriate  quality  sufficient  to  reach  a  defensible  position  regarding  the 
equipment  performance.  Verification  testing  conducted  at  a  single  site  may  not  represent  every 
environmental  situation  which  may  be  acceptable  for  the  equipment  tested,  but  it  will  provide  data 
of  sufficient  quality  to  make  a  judgment  about  the  application  of  the  equipment  under  conditions 
similar  to  those  encountered  in  the  verification  testing. 

It  is  important  to  note  that  verification  of  the  equipment  does  not  mean  that  the  equipment  is 
“certified”  by  NSF  or  EPA.  Rather,  it  recognizes  that  the  performance  of  the  equipment  has  been 
determined  and  verified  by  these  organizations. 

1.3  Scope 

This  protocol  outlines  the  verification  process  for  equipment  designed  to  achieve  arsenic  removal. 
The  scope  of  this  protocol  includes  Testing  Plans  for  package  plants  employing  coagulation  and 
filtration  (CF),  lime  softening  (LS),  ion  exchange  (IE),  activated  alumina  (AA),  reverse  osmosis 
(RO),  electrodialysis  (ED),  and  electrodialysis  reversal  (EDR).  This  protocol  is  not  an  NSF  or 
third-party  consensus  standard  and  it  does  not  endorse  the  products  or  technology  described 
herein. 
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An  overview  of  the  equipment  verification  process  and  the  elements  of  the  Manufacturer  Field 

Operations  Document  to  be  developed  by  the  Manufacturer  are  described  in  this  protocol 

document.  Specifically,  the  Manufacturer  Field  Operations  Document  shall  define  the  following 

elements  of  the  verification  testing: 

•  Roles  and  responsibilities  of  verification  testing  participants; 

•  Procedures  governing  verification  testing  activities  such  as  equipment  operation  and  process 
monitoring;  sample  collection,  preservation,  and  analysis;  and  data  collection  and 
interpretation; 

•  Experimental  design  of  the  Field  Operations  Procedures; 

•  Quality  assurance  (QA)  and  quality  control  (QC)  procedures  for  conducting  tiie  verification 
testing  and  for  assessing  the  quality  of  the  data  generated  fi'om  the  verification  testing;  and, 

•  Health  and  safety  measures  relating  to  electrical,  mechanical  and  other  safety  codes, 

•  Environmental  concerns  relating  to  the  disposal  of  biological  and/or  chemical  wastes. 


Content  of  Field  Operations  Document: 

The  structure  of  the  Manufacturer  Field  Operations  Document  must  conform  to  the  outline 

below:  The  required  components  of  the  Document  will  be  described  in  greater  detail  in  the 

sections  below. 

•  TITLE  PAGE 

•  FOREWORD 

•  TABLE  OF  CONTENTS  -The  Table  of  Contents  for  the  Manufacturer  Field  Operations 
Document  should  include  the  headings  provided  in  this  document  although  they  may  be 
modified  as  appropriate  for  a  particular  type  of  equipment  to  be  tested. 

•  EXECUTIVE  SUMMARY -The  Executive  Summary  describes  the  contents  of  the 
Manufacturer  Field  Operations  Document  (not  to  exceed  two  pages).  A  general  description 
of  the  equipment  and  the  statement  of performance  capabilities  which  will  be  verified  during 
testing  shall  be  included,  as  well  as  the  testing  locations,  a  schedule,  and  a  list  of 
participants. 

•  ABBREVIATIONS  AND  ACRONYMS  -  A  list  of  the  abbreviations  and  acronyms  used  in  the 
Manufacturer  Field  Operations  Document  should  be  provided 

•  EQUIPMENT  VERIFICATION  TESTING  RESPONSIBILITIES  (described  in  the  sections 
below) 

•  EQUIPMENT  CAPABILITIES  AND  DESCRIPTION  (described  in  the  sections  below) 

•  EXPERIMENTAL  DESIGN  (described  in  the  sections  below) 

•  FIELD  OPERATIONS  PROCEDURES  (described  in  the  section  below) 

•  QUALITY  ASSURANCE  TESTING  PLAN  (described  in  the  section  below) 


l\i\s  Draft  Protocol  of  November  8, 1996  may  not  be  duplicated  in  whole  or  in  part  without  the  written  permission  of  NSF  International 


Page  6 


1  •  DATA  MANAGEMENT  AND  ANALYSIS  (described  in  the  section  below) 

2  •  SAFETY  AND  ENVIRONMENTAL  PLAN  (described  in  the  section  below) 

3 

4  Manufacturer  Responsibilities: 

5 

6  Preparation  of  a  Manufacturer  Field  Operations  Document  that  includes  the  information 

7  requested  and  conforms  to  the  requirements  stipulated  in  this  protocol  document,  and  the 

8  applicable  NSF  Equipment  Verification  Testing  Plan  or  Plans. 

9 
10 
11 
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1  2.0  EQUIPMENT  VERIFICATION  TESTING  RESPONSIBILITIES 

2 

3  2.1  Verification  Testing  Organization  and  Participants 

4 

5  This  verification  testing  program  is  being  conducted  by  NSF  International  with  participation  of 

6  manufacturers,  under  the  sponsorship  of  the  EPA  Office  of  Research  and  Development,  National 

7  Risk  Management  Research  Laboratory,  Water  Supply  and  Water  Resources  Research  Division 

8  (WSWRD)  -  Cincinnati,  Ohio.  The  WSWRD  and  NSF  jointly  are  administering  the  Equipment 

9  Verification  testing  Program.  The  NSF's  role  is  to  provide  technical  and  administrative  leadership 

10  and  support  in  conducting  the  testing. 

11 

12  The  specific  responsibilities  of  each  participant  are  discussed  in  Section  2.4.  The  required  content 

13  of  the  field  operations  Manual  and  the  Manufacturer  Responsibilities  are  listed  at  the  end  of  each 

14  section.  In  the  development  of  a  Manufacturer  Field  Operations  Document,  Manufacturers  shall 

1 5  provide  a  table  which  includes  the  name,  affiliation,  and  mailing  address  of  each  participant,  a 

16  point  of  contact,  their  role,  and  telephone,  fax  and  email  address. 

17 

18  2.2  Verification  Testing  Agreement 

19 

20  After  equipment  has  been  accepted  by  NSF  into  the  Environmental  Technology  Verification 

21  Program,  a  letter  agreement  will  be  signed  between  the  Manufacturer  and  the  NSF.  The  purpose 

22  of  the  agreement  is  to  specify  a  framework  of  responsibilities  for  conducting  the  equipment 

23  verification  testing. 

24 

25  It  is  important  to  note  that  the  entire  Manufacturer  Field  Operations  Document,  including  a 

26  Quality  Assurance  Project  Plan  (QAPP),  must  be  approved  by  the  Manufacturer  and  the  NSF 

27  before  the  verification  testing  can  proceed. 

28 

29  2.3  Organization 

30 

3 1  The  organizational  structure  for  the  verification  testing  showing  lines  of  communication  shall  be 

32  provided  by  the  Manufacturer. 

33 

34  2.4  Verification  Testing  Site  Name  and  Location 

35 

36  This  section  discusses  background  information  on  the  verification  testing  site(s),  with  emphasis  on 

37  the  quality  of  the  feed  water,  which  in  some  cases  may  be  the  source  water  at  the  site  and  may 

38  include  surface  as  well  as  ground  waters.  The  Manufacturer  Field  Operations  Document  must 

39  provide  the  site  names  and  locations.  In  most  cases,  the  equipment  will  be  demonstrated  at  more 
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than  one  site.  The  equipment  should  be  tested  under  different  feed  water  quality  (or  source  water 
quality)  and  where  applicable,  imder  seasonal  weather  conditions  (e.g.,  surface  waters). 

2.5  Site  Characteristics 

The  Manufacturer  Field  Operations  Document  must  include  a  description  of  the  test  site.  This 
should  include  a  description  of  where  the  equipment  will  be  located.  If  the  feed  water  is  the 
source  water  for  an  existing  water  treatment  plant,  the  following  information  should  be  provided: 

•  Characteristics  of  the  feed  water  where  it  enters  the  treatment  system; 

•  Sample  of  the  raw  water  (without  the  addition  of  any  water  treatment  chemicals)  for  use 
as  the  feed  water  to  the  equipment  being  tested; 

•  Pattern  of  operation  of  the  raw  water  pumping  system  (is  it  continuous  or  intermittent?); 

•  Characteristics  of  the  facilities  which  will  be  used  for  handling  treated  water  and  waste 
(i.e.,  residuals)  from  the  testing  program. 

For  package  water  treatment  plant  testing,  the  following  questions  need  to  be  answered: 

•  Can  the  finished  and  wastewater  flows  produced  by  the  equipment  being  tested  be 
discharged  in  ways  which  do  not  adversely  impact  the  environment? 

•  Are  water  pollution  discharge  permits  needed? 

•  What  are  the  characteristics  of  the  waters  which  will  be  receiving  these  flows? 

2.6  Responsibilities 

This  section  identifies  the  organizations  involved  in  the  testing  and  describes  the  primary 
responsibilities  of  each  organization.  The  responsibilities  of  the  Manufacturer  will  vary  depending 
on  the  type  of  verification  testing.  Multiple  Manufacturer  testing  at  one  time  is  also  an  option. 

NSF  and  the  equipment  testing  organization  shall  be  responsible  for: 

•  Providing  needed  logistical  support,  establishing  a  communication  network,  and  scheduling 
and  coordinating  the  activities  of  all  verification  testing  participants; 
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1  •  Ensuring  that  locations  selected  as  test  sites  have  feed  water  quality  consistent  with  the 

2  objectives  of  the  verification  testing  (Manufacturer  may  recommend  a  verification  testing 

3  site(s)); 

4 

5  •  Managing,  evaluating,  interpreting,  and  reporting  on  data  generated  by  the  verification  testing; 

6 

7  •  Evaluating  and  reporting  on  the  performance  of  the  technologies. 

8 

9  The  Manufacturer  shall  be  responsible  for  provision  of  the  equipment  to  be  evaluated.  See 

1 0  additional  Manufacturer  responsibilities  listed  below. 

11 

12  Content  of  Manufacturer  Field  Operations  Document  Regarding  Equipment  Verification 

13  T  esting  Responsibilities : 

14 

15  The  Manufacturer,  in  consultation  with  NSF  as  the  technical  lead,  shall  be  responsible  for 

16  including  the  following  elements  in  the  Manufacturer  Field  Operations  Document: 

17 

18  •A  table  which  includes  the  name,  affiliation,  and  mailing  address  of  each  participant,  a  point 

19  of  contact,  their  role,  and  telephone,  fax  and  email  address. 

20 

21  •  Definition  of  the  roles  and  responsibilities  of  appropriate  verification  testing  participants. 

22 

23  •  Organization  of  operational  and  analytical  support. 

24 

25  •  List  of  the  site  name(s)  and  location(s). 

26 

27  •  Description  of  the  test  site(s),  the  site  characteristics  and  identification  of  where  the 

28  equipment  will  be  located. 

29 

30  Manufacturer  Responsibilities: 

31 

32  •  Provision  of  complete,  field-ready  equipment  for  verification  testing; 

33 

34  •  Provision  of  logistical,  and  technical  support,  as  required. 

35 

36  •  Provision  of  assistance  to  the  qualified  testing  organization  during  operation  and  monitoring 

37  of  the  equipment  during  the  verification  testing. 

38 
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1  3.0  EQUIPMENT  CAPABILITIES  AND  DESCRIPTION 

2 

3  3.1  Equipment  Capabilities 

4 

5  The  Manufacturer  must  provide  the  water  quality  objectives  to  be  achieved  in  the  statement  of 

6  performance  capabilities  of  the  equipment  to  be  evaluated  in  the  verification  testing.  Statements 

7  should  also  be  made  regarding  the  applications  of  the  equipment,  what  advantages  it  provides 

8  over  existing  equipment  and  the  known  limitations  of  the  equipment.  The  statement  of 

9  performance  capabilities  must  be  specific  and  be  verifiable  by  a  statistical  analysis  of  the  data.  An 

1 0  example  of  a  satisfactory  statement  of  performance  capabilities  would  be: 

11 

12  "This  reverse  osmosis  package  plant  is  capable  of  achieving  a  minimum  of  95  percent 

1 3  arsenic  removal  when  the  arsenic  in  the  feed  water  is  between  1 0  and  200  /zg/L." 

14 

15  A  statement  of  performance  capabilities  such  as: 

16 

17  "This  package  plant  will  be  capable  of  meeting  the  anticipated  arsenic  MCL  on  a 

1 8  consistent  and  dependable  basis," 

19 

20  would  not  be  acceptable. 

21 

22  The  statement  of  performance  capabilities  shall  indicate  the  range  of  water  quality  with  which  the 

23  equipment  can  be  challenged  while  successfully  treating  the  feed  water.  Statements  of 

24  performance  capabilities  that  are  too  easily  met  may  not  be  of  interest  to  the  potential  user,  while 

25  performance  capabilities  that  are  overstated  may  not  be  achievable.  The  statement  of 

26  performance  capabilities  forms  the  basis  of  the  entire  equipment  verification  testing  and  must  be 

27  chosen  appropriately.  Therefore,  the  design  of  the  Manufacturer  Field  Operations  Document 

28  should  include  a  sufficient  range  of  feed  water  quality  to  permit  verification  of  the  statement  of 

29  performance  capabilities. 

30 

3 1  3.2  Equipment  Description 

32 

33  Description  of  the  equipment  to  be  used  in  the  verification  testing  program  shall  be  provided  by 

34  the  Manufacturer.  Data  plates  shall  be  permanent  and  securely  attached  to  each  production  unit. 

35  The  data  plate  shall  be  easy  to  read  in  English  or  the  language  of  the  intended  user,  located  on  the 

36  equipment  where  it  is  readily  accessible,  and  contain  at  least  the  following  information: 

37 

38  a)  Equipment  Name 

39  b)  Model  # 
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c)  Manufacturer’s  name  and  address 

d)  Electrical  requirements  -  volts,  amps,  and  Hertz 

e)  Serial  Number 

f)  Warning  and  Caution  statements  in  legible  and  easily  discernible  print  size 

g)  Capacity  or  output  rate  (if  applicable) 

Content  of  Manufacturer  Field  Operations  Document  Regarding  Equipment  Capabilities 

and  Description: 

The  Manufacturer  shall  be  responsible  for  including  the  following  elements  in  the  Manufacturer 

Field  Operations  Document.  The  description  of  the  equipment  to  be  demonstrated  should 

include: 

•  A  brief  introduction  and  discussion  of  the  engineering  and  scientific  concepts  on  which  the 
water  treatment  equipment  is  based; 

•  Description  of  the  treatment  train  and  each  unit  process  included  in  the  package  plant; 

•  A  brief  description  of  the  physical  construction/components  of  the  equipment.  Include 
general  environmental  requirements  and  limitations,  weight,  transportability,  ruggedness, 
power  and  other  consumables  needed,  etc:, 

•  A  statement  of  typical  rates  of  consumption  of  chemicals  and  rates  of production  of  wastes 
(concentrates,  residues,  etc.); 

•  Definition  of  the  performance  range  of  the  equipment; 

•  Identification  of  any  special  licensing  requirements  associated  with  the  operation  of  the 
equipment; 

•  Description  of  the  applications  of  the  equipment  and  what  advantages  it  provides  over 
existing  equipment.  Provide  comparisons  in  such  areas  as:  treatment  capabilities, 
requirements  for  chemicals  and  materials,  power,  labor  requirements,  suitability  for  process 
monitoring  and  operation  Jrom  remote  locations,  ability  to  be  managed  by  part-time 
operators; 

•  Discussion  of  the  known  limitations  of  the  equipment.  Include  such  items  as  the  range  of 
feed  water  quality  suitable  for  treatment  with  the  equipment,  the  upper  limits  for 
concentrations  of  regulated  contaminants  that  can  be  removed  to  concentrations  below  the 
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1  MCL,  level  of  operator  skill  required  to  successfully  use  the  equipment 

2 
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1  4.0  EXPERIMENTAL  DESIGN 

2 

3  This  section  discusses  the  objectives  of  the  verification  testing,  factors  that  must  be  considered  to 

4  meet  the  performance  objectives,  and  the  statistical  and  other  means  that  the  NSF  will  use  to 

5  evaluate  the  results  of  the  verification  testing. 

6 

7  4.1  Objectives 

8 

9  The  objectives  of  this  verification  testing  are  to  evaluate  equipment  in  the  following  areas: 

10 

11  •  Performance  relative  to  manufacturer's  stated  range  of  equipment  capabilities; 

12 

13  •  Impacts  of  feed  water  quality  variations  on  its  performance; 

14 

15  •  Logistical,  human,  and  economic  resources  necessary  to  operate  the  equipment; 

16 

17  •  Reliability,  ruggedness,  cost,  range  of  usefulness,  and  ease  of  operation. 

18 

19  If  the  system  is  tested  on  surface  water  feed,  additional  information  required  include: 

20 

21  •  How  well  it  performs  relative  to  the  requirements  of  the  SWTR  and  any  other  specific  or 

22  anticipated  water  quality  regulation; 

23 

24  •  How  well  it  performs  relative  to  the  performance  recommendations  for  water  filtration 

25  processes  established  in  the  Partnership  for  Safe  Water. 

26 

27  The  Manufacturer  shall  be  responsible  for  selection  of  those  treatment  challenges  (tests)  listed  in 

28  NSF  test  plans  that  are  most  appropriate  for  their  equipment.  For  example,  if  equipment  is  only 

29  intended  for  use  with  groundwater,  the  use  of  untreated  river  water  as  the  feed  water  would  not 

30  be  appropriate. 

31 

32  4.2  Equipment  Characteristics 

33 

34  This  section  discusses  factors  that  will  be  considered  in  the  design  and  implementation  of  the 

35  verification  testing.  These  factors  include: 

36 

37  •  Ease  of  operation 

38  •  Degree  of  operator  attention  required 

39  •  Response  of  equipment  and  treatment  process  to  changes  in  feed  water  quality 
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1  •  Electrical  requirements 

2  •  Feed  water  flow  requirements 

3  •  Discharge  requirements  (residuals  and  treated  water  flows) 

4  •  Equipment  footprint 

5  •  Unit  processes  included  in  treatment  train 

6  •  Chemicals  needed 

7 

8  Verification  testing  procedures  will  simulate  routine  conditions  as  much  as  possible  and  in  most 

9  cases  testing  may  be  done  in  the  field;  hence  in  that  circumstance  field  conditions  simulation 

1 0  would  not  be  necessary . 

11 

12  4.2.1  Qualitative  Factors 

13 

14  Some  factors,  while  important,  are  difficult  or  impossible  to  quantify.  These  are  considered 

15  qualitative  factors.  Important  factors  that  cannot  easily  be  quantified  are  the  portability  of 

16  equipment  and  logistical  requirements  necessary  for  using  it. 

17 

1 8  Typical  qualitative  factors  to  be  discussed  are  listed  below,  and  others  may  be  added.  The 

19  Manufacturer  Field  Operations  Document  should  discuss  those  factors  that  are  appropriate  to  the 

20  test  equipment. 

21 

22  •  Reliability  or  susceptibility  to  adverse  environmental  conditions 

23  •  Effect  of  operator  experience  on  the  treatment  results. 

24 

25  4.2.2  Quantitative  Factors 

26 

27  Many  factors  in  this  verification  testing  can  be  quantified  by  various  means.  Typical  quantitative 

28  factors  to  be  discussed  are  listed  below,  and  others  may  be  added.  The  Manufacturer  Field 

29  Operations  Document  shall  discuss  those  factors  that  are  appropriate  to  the  test  equipment. 

30 

31  •  Power  and  consumable  supply  (such  as  chemical)  requirements 

32  •  Cost  of  operation  and  waste  disposal 

33  •  Budget  for  preventative  maintenance 

34  •  Length  of  operating  cycle. 

35 

36  These  quantitative  factors  will  be  used  as  an  initial  benchmark  to  assess  equipment  performance. 

37 

38  4.3  Water  Quality  Considerations 

39 
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1  Water  treatment  equipment  is  used  to  treat  water  and  change  the  quality  of  feed  water  (or  raw 

2  water)  so  it  meets  the  requirements  of  the  Safe  Drinking  Water  Act  (SDWA)  and  amendments  to 

3  die  SDWA  and  is  aesthetically  pleasing  and  palatable.  The  experimental  design  shall  be  developed 

4  so  the  relevant  questions  about  water  treatment  equipment  capabilities  can  be  answered. 

5 

6  Equipment  Manufacturers  should  recognize  that  it  is  highly  unlikely  that  any  single  item  of  water 

7  treatment  process  equipment  can  successfully  treat  any  conceivable  feed  water  containing  all  of 

8  the  regulated  contaminants  and  produce  a  treated  water  that  meets  the  quality  requirements  for 

9  every  regulated  contaminant.  Although  multiple  processes  could  be  placed  in  a  treatment  train  to 

10  accomplish  such  a  goal,  for  most  public  water  systems  such  comprehensive  treatment  capability  is 

1 1  not  needed  and  would  not  be  cost  effective.  Therefore,  drinking  water  treatment  has  been 

12  focused  on  improving  the  water  quality  aspects  of  concern  for  particular  locations.  The  range  of 

13  contaminants  or  water  quality  problems  that  can  be  addressed  by  water  treatment  equipment 

14  varies,  and  some  package  treatment  equipment  can  address  a  broader  range  of  problems  than 

15  other  types.  Manufacturers  should  carefiilly  consider  the  capabilities  and  limitations  of  their 

16  equipment  and  prepare  Manufacturer  Field  Operations  Documents  that  challenge  their  equipment 

17  sufficiently  to  enable  the  verification  testing  to  provide  a  broad  market  for  their  products,  while 

1 8  recognizing  the  limitations  of  the  equipment  and  not  subjecting  it  to  testing  for  contaminant 

19  removal  when  the  outcome  is  known  in  advance  to  be  failure  and  the  testing  would  be  fiuitless. 

20  Manufacturers  shall  use  NSF  Equipment  Verification  Testing  Plans  as  the  basis  for  the  specific 

21  Manufacturer  Field  Operations  Documents. 

22 

23  4.3.1  Feed  Water  Quality 

24 

25  One  of  the  key  aspects  related  to  water  treatment  equipment  performance  verification  is  the  range 

26  of  feed  water  quality  that  can  be  treated  successfully,  resulting  in  treated  water  quality  that  meets 

27  water  quality  goals  or  regulatory  requirements.  As  the  range  of  feed  water  quality  that  can  be 

28  treated  by  the  equipment  becomes  broader,  the  potential  applications  for  treatment  equipment 

29  with  verified  performance  capabilities  should  also  increase.  Characteristics  of  feed  water  quality 

30  that  can  be  important  for  treatment  equipment  intended  for  arsenic  removal  include: 

31 

32  •  turbidity,  suspended  particles 

33  •  arsenic  concentration 

34  •  arsenic  species 

35  •  other  ions  in  solution,  particularly  sulfate,  fluoride,  and  silica 

36  •  temperature,  with  temperatures  near  freezing  having  potential  for  the  most  difficult  treatment 

37  conditions 

38  •  dissolved  organic  carbon  (DOC),  total  organic  carbon  (TOC) 

39  •  pH,  alkalinity,  and  hardness 
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1  •  iron  and  manganese 

2  •  total  dissolved  solids  (TDS) 

3 

4  One  of  the  questions  often  asked  by  regulatory  engineers  in  approving  package  water  treatment 

5  equipment  is,  "Has  it  been  shown  to  work  on  the  water  where  you  propose  to  put  it?"  By 

6  covering  a  large  range  of  water  qualities  the  verification  testing  is  more  likely  to  provide  an 

7  affirmative  answer  to  that  question. 

8 

9  4.3.2  Treated  Water  Quality 

10 

1 1  Treated  water  quality  is  very  important.  If  a  Manufacturer  states  that  water  treatment  equipment 

12  can  be  used  to  achieve  a  targeted  arsenic  removal  under  a  range  of  influent  arsenic  levels,  the 

1 3  verification  testing  must  be  performed  to  confirm  this  statement.  If  the  Manufacturer  states  the 

14  water  treatment  equipment  can  meet  other  specified  regulatory  requirements,  the  verification 

1 5  testing  must  provide  data  that  support  such  a  statement  of  capabilities.  For  example,  if  the 

1 6  Manufacturer  states  that  this  equipment  can  meet  the  goals  defined  in  the  Surface  Water 

17  Treatment  Rule  (SWTR)  in  addition  to  arsenic  removal,  the  Manufacturer  must  demonstrate  that 

18  the  goals  stipulated  by  the  SWTR  (i.e.,  filtered  water  turbidity  requirements)  are  met  during  the 

19  testing. 

20 

21  In  addition,  the  Manufacturer  may  wish  to  make  a  statement  about  performance  capabilities  of  the 

22  equipment  for  removal  of  other  regulated  contaminants  under  the  SDWA. 

23 

24  Furthermore,  some  water  treatment  equipment  can  be  used  to  meet  aesthetic  goals  that  are  not 

25  included  as  regulatory  requirements  of  the  SDWA.  Water  quality  considerations  that  go  beyond 

26  regulatory  requirements  and  may  be  important  for  some  small  systems  include: 

27 

28  •  color,  taste  and  odor 

29  •  TDS 

30  •  iron  and  manganese 

31 

32  Finally,  other  water  quality  parameters  are  useful  for  assessing  equipment  performance.  These 

33  may  include: 

34 

35  •  particle  count  or  concentration 

36  •  TOC 

37 

38  The  Manufacturer  is  encouraged  to  address  these  factors  in  the  design  of  the  verification  testing 

39  program. 
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1 

2  4.4  Verification  Testing  Schedule 

3 

4  Verification  testing  activities  include  equipment  set-up,  initial  operation,  verification  operation, 

5  and  sampling  and  analysis.  Initial  operations  are  intended  to  be  conducted  so  Manufacturers  can 

6  test  their  equipment  and  be  sure  it  is  fimctioning  as  intended.  If  feed  water  (or  source  water) 

7  quality  influences  operation  and  performance  of  the  equipment  being  tested,  the  initial  operations 

8  period  serves  as  the  shake-down  period  for  determining  appropriate  operating  parameters. 

9 

10  For  water  treatment  equipment  involving  coagulation  and  filtration  for  arsenic  removal,  a  period 

1 1  of  bench-scale  testing  (jar  testing)  followed  by  initial  equipment  operation  may  be  needed  to 

12  determine  the  appropriate  coagulant  chemical  doses  and  pH  values  of  coagulated  water.. 

13  Procedures  for  jar  testing  are  provided  in  the  American  Water  Works  Association's  Manual  M37, 

14  "Operational  Control  of  Coagulation  and  Filtration  Processes." 

15 

16  The  times  selected  for  verification  testing  may  need  to  include  cold  weather  operations  because  of 

17  seasonal  water  quality  variations  and  because  of  the  impact  of  cold  temperatures  on  filtration 

1 8  performance: 

19 

20  •  cold  temperatures  (1  “  to  5  ®C)  can  have  an  adverse  affect  on  some  water  treatment  processes 

21  due  to  the  increase  in  water  viscosity  at  cold  temperatures; 

22 

23  •  cold  temperatures  have  an  adverse  effect  on  the  performance  of  chemical  coagulation  due  to 

24  the  reduced  rate  of  coagulant  reaction  and  the  reduction  in  interparticle  contacts; 

25 

26  •  water  flows  treated  by  many  types  of  package  water  treatment  equipment  are  so  great  (80  to 

27  100  liters/minute,  or  greater)  that  use  of  mechanical  refrigeration  to  attain  temperatures  of  1° 

28  to  5  °C  would  be  prohibitively  expensive. 

29 

30  Verification  testing  with  operations  for  which  data  are  collected  and  used  to  verify  performance 

31  would  be  done  after  initial  operations  are  completed.  NSF  International  is  to  be  notified  of  the 

32  date  when  verification  testing  is  scheduled  to  begin. 

33 

34  Content  of  Manufacturer  Field  Operations  Document  Regarding  Experimental  Design: 

35 

36  The  Manufacturer  shall  be  responsible  for  including  the  following  elements  in  the  Manufacturer 
2)1  Field  Operations  Document: 

38 

39  •  Identification  of  the  qualitative  and  quantitative  factors  of  equipment  operation  to  be 
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addressed  in  the  verification  testing  program. 

•  Identification  and  discussion  of  the  water  treatment  problem  or  problems  that  the  equipment 
is  designed  to  address,  how  the  equipment  will  solve  the  problem,  and  who  would  be  the 
potential  users  of  the  equipment. 

•  Identification  of  the  range  of  key  water  quality  parameters,  given  in  applicable  NSF  Testing 
Plans,  which  the  equipment  is  intended  to  address  and  for  which  the  equipment  is  applicable. 

•  Identification  of  the  key  parameters  of  treated  water  quality  that  will  be  used  for  evaluation 
of  equipment  performance  for  arsenic  removal.  Parameters  of  significance  for  treated  water 
quality  were  listed  above  in  Section  4.3.2.  and  in  applicable  NSF  Testing  Plans. 

•  Detailed  outline  of  the  verification  testing  schedule,  with  regard  to  seasonal  testing  periods 
and  testing  periods  at  different  temperature  conditions. 
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1  5.0  FIELD  OPERATIONS  PROCEDURES 

2 

3  5.1  Equipment  Operations  and  Design 

4 

5  The  NSF  Verification  Testing  Plan  specifies  procedures  that  shall  be  used  to  ensure  the  accurate 

6  documentation  of  both  water  quality  and  equipment  performance.  Careful  adherence  to  these 

7  procedures  will  result  in  definition  of  verifiable  performance  of  equipment.  (Note  that  this 

8  protocol  may  be  associated  with  a  number  of  different  NSF  Equipment  Verification  Testing  Plans 

9  for  different  types  of  arsenic  removal  process  equipment.) 

10 

1 1  Design  aspects  of  water  treatment  process  equipment  often  provide  a  basis  for  approval  by  state 

12  regulatory  engineers  and  can  be  used  to  ascertain  if  process  equipment  intended  for  larger  or 

13  smaller  flows  than  that  evaluated  in  the  verification  testing  program  actually  involves  the  same 

14  operating  parameters  that  were  relevant  to  the  verification  testing.  Specific  design  aspects  to  be 

15  included  in  the  Manufacturer  Field  Operations  Document  are  provided  in  detail,  in  the 

16  Manufacturer  Responsibilities  section  below. 

17 

18  5.2  Selection  of  Analytical  Laboratory  and  Field  Testing  Organization 

19 

20  To  assess  the  performance  of  the  equipment,  the  water  quality  attained  using  the  equipment  shall 

21  be  determined  by  on-site  analysis  or  by  an  analytical  laboratory,  by  a  field  operations  and  testing 

22  organization  or  by  a  combination  of  both.  The  Manufacturer  shall  use  an  NSF-qualified  testing 

23  organization  (laboratory  or  engineering  company).  The  NSF  shall  provide  a  list  of  qualified 

24  testing  organizations  from  which  Manufacturers  can  select  for  submission  of  analytical  samples. 

25  For  field  operations,  the  Manufacturer  shall  employ  an  NSF-qualified  field  testing  organization. 

26  These  organizations  may  include  engineering  consulting  firms,  universities,  or  other  qualified 

27  scientific  organizations  with  experience  operating  pilot  plant  equipment. 

28 

29  In  addition  to  NSF  qualification,  the  analytical  laboratories  selected  must  also  be  certified  for 

30  analysis  of  water  samples  for  SDWA  compliance  by  one  or  more  states  having  SDWA  primacy. 

3 1  Because  of  the  variability  of  acceptance  of  laboratories  from  state  to  state,  use  of  an  analytical 

32  laboratory  certified  in  a  large  number  of  states  is  recommended.  Laboratories  approved  for 

33  sample  analysis  for  the  EPA's  Information  Collection  Rule  would  have  nationally  recognized 

34  capabilities.  Analytical  results  from  the  laboratory  are  to  be  provided  directly  to  the  NSF  to 

35  maintain  data  integrity. 

36 

37 

38 

39  5.3  Communications,  Documentation,  Logistics,  and  Equipment 
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1  NSF  will  communicate  regularly  with  the  verification  testing  participants  to  coordinate  all  field 

2  activities  associated  with  this  verification  testing  and  to  resolve  any  logistical,  technical,  or  QA 

3  issues  that  may  arise  as  the  verification  testing  progresses.  The  successfiil  implementation  of  the 

4  verification  testing  will  require  detailed  coordination  and  constant  communication  between  all 

5  verification  testing  participants. 

6 

7  All  Manufacturer/NSF  field  activities  shall  be  thoroughly  documented.  Field  documentation  will 

8  include  field  logbooks,  photographs,  field  data  sheets,  and  chain-of-custody  forms.  The  qualified 

9  testing  organization  shall  be  responsible  for  maintaining  all  field  documentation.  The  following 

10  guidelines  should  be  followed: 

11 

12  •  Field  notes  shall  be  kept  in  a  bound  logbook 

13  •  Field  logbooks  shall  be  used  to  record  all  water  treatment  equipment  operating  data. 

14  •  Each  page  shall  be  sequentially  numbered 

15  •  Each  page  shall  be  labeled  with  the  project  name  and  number 

16  •  Completed  pages  shall  be  signed  and  dated  by  the  individual  responsible  for  the  entries. 

17  •  Errors  shall  have  one  line  drawn  through  them  and  this  line  shall  be  initialed  and  dated. 

18 

19  All  photographs  shall  be  logged  in  the  field  logbook.  These  entries  shall  include  the  time,  date, 

20  subject  of  the  photograph,  and  the  identity  of  the  photographer.  Any  deviations  from  the 

21  approved  final  Manufacturer  Field  Operations  Document  shall  be  thoroughly  documented  in  the 

22  field  logbook  and  provided  to  the  NSF. 

23 

24  Original  field  sheets  and  chain-of-custody  forms  shall  accompany  all  samples  shipped  to  the 

25  analytical  laboratory.  Copies  of  field  sheets  and  chain-of-custody  forms  for  all  samples  shall  be 

26  provided  to  the  NSF. 

27 

28  5.4  Initial  Operations 

29 

30  Initial  operations  will  allow  equipment  Manufacturers  to  refine  their  operating  procedures  and  to 

31  make  operation  adjustments  as  needed  to  successfully  treat  the  feed  water.  Information  generated 

32  through  this  period  of  operation  may  be  used  to  revise  the  Manufacturer  Field  Operations 

33  Document,  if  necessary.  A  failure  at  this  point  in  the  verification  testing  could  indicate  a  lack  of 

34  capability  of  the  process  equipment  and  the  verification  testing  might  be  canceled. 

35 

36  5.5  Equipment  Operation  and  Water  Quality  Sampling  for  Verification  Testing 

37 

38  The  qualified  testing  organization  will  supervise  equipment  operation  and  water  quality  sampling 

39  and  analysis  during  the  verification  phase  of  testing,  using  the  procedures  described  below.  The 
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1  NSF  will  oversee  or  audit  these  activities.  All  field  activities  shall  conform  with  requirements 

2  provided  in  the  Manufacturer  Field  Operations  Document  that  was  developed  and  approved  for 

3  the  verification  testing  being  conducted. 

4 

5  If  unanticipated  or  unusual  situations  are  encountered  that  may  alter  the  plans  for  equipment 

6  operation,  water  quality  sampling,  or  data  quality,  the  situation  shall  be  discussed  with  the  NSF 

7  technical  lead.  Any  deviations  from  the  approved  final  Manufacturer  Field  Operations  Document 

8  shall  be  thoroughly  documented. 

9 

1 0  During  routine  operation  of  water  treatment  equipment,  the  following  items  should  be 

1 1  documented  and  described  by  the  qualified  Testing  Organization,  the  Water  System,  or  the  Plant 

12  Operator: 

13 

14  • 

15  • 

16 

17 

18  • 

19 

20  Content  of  Manufacturer  Field  Operations  Document  Regarding  Field  Operations 

21  Procedures: 

22 

23  The  Manufacturer  shall  be  responsible  for  including  the  following  elements  in  the  Manufacturer 

24  Field  Operations  Document: 

25 

26  •A  table  summary  of  the  proposed  time  schedule  for  operating  and  testing, 

27  •  Field  operating  procedures  for  the  equipment  and  performance  testing,  based  upon  the  NSF 

28  Equipment  Verification  Testing  Plan,  including: 

29 

30  ►  listing  of  operating  parameters 

31  ►  ranges  for  feed  water  quality 

32  ►  sampling  and  analysis  strategy. 

33 

34  Manufacturer  Responsibilities: 

35 

36  •  Provision  of  all  equipment  needed  for  field  work  associated  with  this  verification  testing; 

37  •  Provision  of  a  complete  list  of  all  equipment  to  be  used  in  the  verification  testing.  A  table 

38  format  is  suggested; 

39  •  Provision  of  field  operating  procedures. 


Total  number  of  hours  during  which  the  equipment  was  operated  each  day; 

Number  of  hours  each  day  during  which  the  operator  was  working  at  the  treatment  plant 
and  performing  tasks  related  to  water  treatment  and  the  operation  of  the  treatment 
equipment; 

Tasks  performed  during  equipment  operation. 
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1  6.0  QUALITY  ASSURANCE  PROJECT  PLAN  (QAPP) 

2 

3  The  QAPP  for  this  verification  testing  specifies  procedures  that  shall  be  used  to  ensure  data 

4  quality  and  integrity.  Careful  adherence  to  these  procedures  will  ensure  that  data  generated  from 

5  the  verification  testing  will  provide  sound  analytical  results  that  can  serve  as  the  basis  for 

6  performance  verification. 

7 

8  6.1  Purpose  and  Scope 

9 

10  The  primary  purpose  of  this  section  is  to  outline  steps  that  shall  be  taken  by  operators  of  the 

1 1  equipment  and  by  the  analytical  laboratory  to  ensure  that  data  resulting  from  this  verification 

12  testing  is  of  known  quality  and  that  a  sufficient  number  of  critical  measurements  are  taken. 

13 

14  6.2  Quality  Assurance  Responsibilities 

15 

1 6  The  Manufacturer  project  manager  is  responsible  for  coordinating  the  preparation  of  the  QAPP 

17  for  this  verification  testing  and  for  its  approval  by  the  NSF.  The  qualified  testing  organization 

1 8  project  manager,  with  oversight  from  NSF,  shall  ensure  that  the  QAPP  is  implemented  during  all 

19  verification  testing  activities. 

20 

21  The  entire  Manufacturer  Field  Operations  Document  including  the  QAPP  must  be  approved  by 

22  the  Manufacturer  and  the  NSF  before  the  verification  testing  can  proceed.  The  NSF  must  review 

23  and  either  approve  the  QAPP  or  provide  reasons  for  rejection  of  the  QAPP  along  with 

24  suggestions  on  how  to  modify  the  QAPP  to  make  it  acceptable,  provided  that  the  Manufacturer 

25  has  made  a  good  faith  effort  to  develop  an  acceptable  QAPP  (i.e.  the  QAPP  is  75  to  80% 

26  acceptable  with  only  minor  changes  needed  to  produce  an  acceptable  plan.  NSF  will  not  write 

27  QAPPs  for  Manufacturers.) 

28 

29  A  number  of  individuals  may  be  responsible  for  monitoring  equipment  operating  parameters  and 

30  for  sampling  and  analysis  QA/QC  throughout  the  verification  testing.  Primary  responsibility  for 

3 1  ensuring  that  both  equipment  operation  and  sampling  and  analysis  activities  comply  with  the 

32  QA/QC  requirements  of  the  Manufacturer  Field  Operations  Document  (Section  6)  shall  rest  with 

33  the  qualified  testing  organization,  with  oversight  by  the  NSF.  QA/QC  activities  for  the  equipment 

34  shall  include  those  activities  recommended  by  Manufacturer  and  those  required  by  the  NSF  to 

35  assure  the  verification  testing  will  provide  data  of  the  necessary  quality. 

36 

37  QA/QC  activities  for  the  analytical  laboratory  that  analyzes  samples  sent  off-site  shall  be  the 

38  responsibility  of  that  analytical  laboratory's  supervisor.  If  problems  arise  or  any  data  appear 

39  unusual,  they  shall  be  thoroughly  documented  and  corrective  actions  shall  be  implemented  as 
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1  specified  in  this  section.  The  QA/QC  measurements  made  by  the  off-site  analytical  laboratory  are 

2  dependent  on  the  analytical  methods  being  used. 

3 

4  6.3  Data  Quality  Indicators 

5 

6  The  data  obtained  during  the  verification  testing  must  be  of  sound  quality  for  conclusions  to  be 

7  drawn  on  the  equipment.  For  all  measurement  and  monitoring  activities  conducted  for  equipment 

8  verification,  the  NSF  and  EPA  require  that  data  quality  parameters  be  established  based  on  the 

9  proposed  end  uses  of  the  data.  Data  quality  parameters  include  four  indicators  of  data  quality: 

1 0  representativeness,  completeness,  accuracy,  and  precision. 

11 

12  Treatment  results  generated  by  the  equipment  must  be  verifiable  for  the  purposes  of  this  program 

13  to  be  fulfilled.  High  quality,  well  documented  analytical  laboratory  results  are  essential  for 

14  meeting  the  purpose  and  objectives  of  this  verification  testing.  Therefore,  the  following  indicators 

15  of  data  qucdity  shall  be  closely  evaluated  to  determine  the  performance  of  the  equipment  when 

1 6  measured  against  data  generated  by  the  analytical  laboratory. 

17 

18  6.3.1  Representativeness 

19 

20  Representativeness  refers  to  the  degree  to  which  the  data  accurately  and  precisely  represent  the 

21  conditions  or  characteristics  of  the  parameter  represented  by  the  data.  In  this  verification  testing, 

22  representativeness  will  be  ensured  by  executing  consistent  sample  collection  procedures,  including 

23  sample  locations,  timing  of  sample  collection,  sampling  procedures,  sample  preservation,  sample 

24  packaging,  and  sample  shipping.  Representativeness  also  will  be  ensured  by  using  each  method  at 

25  its  optimum  capability  to  provide  results  that  represent  the  most  accurate  and  precise 

26  measurement  it  is  capable  of  achieving. 

27 

28  For  equipment  operating  data,  representativeness  entails  collecting  a  sufficient  quantity  of  data 

29  during  operation  to  be  able  to  detect  a  change  in  operations.  For  most  water  treatment  processes 

30  involving  arsenic  removal,  detecting  a  +/- 10  percent  change  in  an  operating  parameter  (i.e. 

3 1  headloss,  pressure)  is  sufficient.  Mixing  energies  and  flows  should  also  be  known  within  +/- 10 

32  percent. 

33 

34  6.3.2  Completeness 

35 

36  Completeness  refers  to  the  amount  of  data  collected  from  a  measurement  process  compared  to 

37  the  amount  that  was  expected  to  be  obtained.  For  this  verification  testing,  completeness  refers  to 

38  the  proportion  of  valid,  acceptable  data  generated  using  each  method.  The  completeness 

39  objective  for  data  generated  during  this  verification  testing  is  85  percent. 
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6.3.3  Accuracy 

The  definition  of  accuracy  depends  on  the  context,  and  is  defined  as  the  following: 

•  Water  quality  analyses  -  difference  between  a  sample  result  and  the  reference  or  true  value  for 
the  sample.  Loss  of  accuracy  can  be  caused  by: 

►  errors  in  standards  preparation 

►  equipment  calibrations 

►  loss  of  target  analyte  in  the  extraction  process 

►  chemical  interferences 

►  systematic  or  carryover  of  contamination  from  one  sample  to  the  next. 

•  Equipment  operating  parameters  -  difference  between  the  reported  operating  condition  and 
the  actual  operating  condition. 

•  Water  flow  -  difference  between  the  reported  flow  indicated  by  a  flow  meter  and  the  flow  as 
actually  measured  on  the  basis  of  known  volumes  of  water  and  carefully  defined  times  (bucket 
and  stopwatch  technique)  as  practiced  in  hydraulics  laboratories  or  water  meter  calibration 
shops. 

•  Mixing  equipment  -  difference  between  an  electronic  readout  for  equipment  RPMs  and  the 
actual  measurement  based  on  counted  revolutions  and  measured  time. 

•  Head  loss  measurement  -  determined  by  using  measuring  tapes  to  check  the  calibration  of 
piezometers  for  gravity  filters  or  by  checking  the  calibration  of  pressure  gauges  for  pressure 
filters. 

Meters  and  gauges  must  be  checked  periodically  for  accuracy,  and  when  proven  to  be  dependable 
over  time,  the  time  interval  between  accuracy  checks  can  be  increased. 

6.3.4  Precision 

Precision  refers  to  the  degree  of  mutual  agreement  among  individual  measurements  and  provides 
an  estimate  of  random  error.  For  example,  precision  for  pH  shall  be  performed  by  grabbing  a 
minimum  of  three  samples  under  the  same  conditions  (i.e.  at  the  same  location,  the  same  time, 
same  sampler)  for  analyses.  The  variation  between  the  measurements  will  vary  depending  on  the 
type  of  analysis  being  performed.  It  is  suggested  that  Table  1020  mStandard  Methods  (18th 
edition)  be  used  as  a  guide  for  the  acceptable  variation  for  the  different  analyses.  If  the  variation 
between  the  measurements  is  greater  than  what  is  suggested  in  this  table,  steps  should  be  taken  to 
determine  the  possible  sources  for  the  variation  and  corrected. 

6.4  Quality  Control  Checks 
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1  This  section  describes  the  QC  requirements  that  apply  to  both  the  treatment  equipment  and  the 

2  on-site  water  quality  analyses.  It  also  contains  a  discussion  of  the  corrective  action  to  be  taken  if 

3  the  QC  parameters  fall  outside  of  the  evaluation  criteria. 

4 

5  The  quality  control  checks  provide  a  means  of  measuring  the  quality  of  data  produced.  The 

6  Manufacturer  may  not  need  to  use  all  the  ones  identified  in  this  section.  The  selection  of  the 

7  appropriate  quality  control  checks  depends  on  the  equipment,  the  experimental  design  and  the 

8  performance  goals.  The  selection  of  quality  control  checks  will  be  based  on  discussions  among 

9  the  Manufacturer  and  die  NSF.  Some  types  of  quality  control  checks  applicable  to  operating 

1 0  water  treatment  equipment  were  described  in  Section  6.3.4. 

11 

12  6.4.1  Quality  Control  for  Equipment  Operation 

13 

14  This  section  will  explain  the  methods  to  be  used  to  check  the  accuracy  of  equipment  operating 

1 5  parameters  and  the  frequency  with  which  these  quality  control  checks  will  be  made.  A  key  aspect 

16  of  the  Equipment  Verification  Testing  Program  is  to  provide  operating  results  that  will  be  widely 

17  accepted  by  state  regulatory  engineers.  If  the  quality  of  the  equipment  operating  data  can  not  be 

1 8  verified,  then  the  water  quality  analytical  results  may  be  of  no  value.  Because  water  can  not  be 

1 9  treated  if  equipment  is  not  operating,  obtaining  valid  equipment  operating  data  is  a  prime  concern 

20  for  verification  testing. 

21 

22  An  example  of  the  need  for  QC  for  equipment  operations  is  an  incident  of  state  rejection  of  test 

23  data  because  the  treatment  equipment  had  no  flow  meter  to  use  for  determining  engineering  and 

24  operating  parameters  related  to  flow. 

25 

26  6.4.2  Water  Quality  Data 

27 

28  After  treatment  equipment  is  being  operated  and  water  is  being  treated,  the  results  of  the 

29  treatment  are  interpreted  in  terms  of  water  quality.  Therefore  the  quality  of  water  sample 

30  analytical  results  is  just  as  important  as  the  quality  of  the  equipment  operating  data.  Most  QA 

3 1  plans  emphasize  analytical  QA.  The  important  aspects  of  sampling  and  analytical  QA  are  given 

32  below: 

33 

34  6.4.2.1  Duplicate  Samples 

35 

36  Duplicate  samples  must  be  analyzed  to  determine  the  precision  of  analysis.  The  procedure  for 

37  determining  samples  to  be  analyzed  in  duplicate  shall  be  provided  with  the  frequency  of  analysis 

38  and  the  approximate  number.  In  order  to  ensure  data  accuracy,  at  least  10  percent  of  the  arsenic 

39  samples  analyzed,  or  one  sample,  whichever  is  greater,  should  be  duplicate  samples. 
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1  6.4.2.2  Method  Blanks 

2 

3  Method  blanks  are  used  to  evaluate  analytical  method-induced  contamination,  which  may  cause 

4  false  positive  results.  If  false  positive  results  occur,  sample  analysis  must  be  halted  until  the 

5  source  of  the  false  positive  has  been  determined  (i.e.,  instrument,  sample  bottles,  sampler  error). 

6  Some  analytical  measurements  may  be  more  prone  to  contamination  than  other  analyses  (i.e. 

7  samples  analyzed  for  volatile  organics  may  be  more  susceptible  to  contamination  than  for 

8  inorganic  chemical  analyses).  The  number  of  method  blanks  required  depends  on  the  sensitivity  of 

9  the  analysis  to  contamination,  but  should  be  no  less  than  10-percent  of  the  samples,  or  one 

1 0  sample,  whichever  is  greater. 

11 

12  6.4 .2.3  Spiked  Samples 

13 

14  The  use  of  spiked  samples  will  depend  on  the  testing  program,  and  the  contaminants  to  be 

15  removed.  If  spiked  samples  are  to  be  used,  specify  the  procedure,  frequency,  acceptance  criteria, 

1 6  and  actions  if  criteria  are  not  met. 

17 

18  6.4.2.4  Travel  Blanks 

19 

20  Travel  blanks  should  be  provided  to  the  analytical  laboratory  to  evaluate  travel-related 

21  contamination.  The  procedure,  frequency,  acceptance  criteria,  and  actions  if  criteria  are  not  met 

22  for  the  travel  blanks  must  be  clearly  stated.  It  is  recognized  that  not  all  analyses  may  be  subjected 

23  to  contamination  due  to  travel  time  (e.g.,  inorganic  constituents).  In  these  cases,  travel  blanks 

24  may  not  be  needed  on  a  routine  basis  if  it  can  be  demonstrated  that  the  analyses  are  not  prone  to 

25  contamination  caused  by  travel  time. 

26 

27  6.4.2.5  Performance  Evaluation  Samples  for  On-Site  Water  Quality  Testing 

28 

29  Performance  evaluation  samples  are  samples  whose  composition  is  unknown  to  the  analyst  that 

30  are  used  to  evaluate  analytical  performance.  Analysis  of  PE  samples  shall  be  conducted  before 

3 1  pilot  testing  is  initiated  by  submission  of  samples  to  the  analytical  laboratory  and  to  the  equipment 

32  testing  organizations,  if  appropriate.  The  control  limits  for  the  PE  samples  will  be  used  to 

33  evaluate  the  equipment  testing  organization's  and  analytical  laboratory's  method  performance. 

34  One  kind  of  PE  sample  that  would  be  used  for  on-site  QA  in  most  studies  performed  under  this 

35  protocol  would  be  a  pH  PE  sample. 

36 

37  PE  samples  come  with  statistics  about  each  sample  which  have  been  derived  from  the  analysis  of 

38  the  sample  by  a  number  of  laboratories  using  EPA-approved  methods.  These  statistics  include  a 

39  true  value  of  the  PE  sample,  a  mean  of  the  laboratory  results  obtained  from  the  analysis  of  the  PE 
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1  sample,  and  an  acceptance  range  for  sample  values.  The  analytical  laboratory  is  expected  to 

2  provide  results  from  the  analysis  of  the  PE  samples  that  meet  the  performance  objectives  of  the 

3  verification  testing. 

4 

5  6.5  Data  Reduction,  Validation,  and  Reporting 

6 

7  To  maintain  good  data  quality,  specific  procedures  shall  be  followed  during  data  reduction, 

8  validation,  and  reporting.  These  procedures  are  detailed  below. 

9 

10  6.5.1  Data  Reduction 

11 

12  Data  reduction  refers  to  the  process  of  converting  the  raw  results  from  the  equipment  into 

13  concentration  or  other  data  in  a  form  to  be  used  in  the  comparison.  The  procedures  to  be  used 

14  will  be  equipment  dependent.  The  purpose  of  this  step  is  to  provide  data  which  will  be  used  to 

15  verify  the  statement  of  performance  capabilities.  These  data  shall  be  obtained  from  logbooks, 

16  instrument  outputs,  and  computer  outputs  as  appropriate. 

17 

18  6.5.2  Data  Validation 

19 

20  There  are  two  types  of  data  validation  which  need  to  be  addressed,  field  data  and  laboratory  data. 

21  For  the  field  data  (including  data  collected  from  field  laboratories): 

22 

23  •  The  operator  shall  verify  the  completeness  of  the  appropriate  data  forms  and  the  completeness 

24  and  correctness  of  data  acquisition  and  reduction; 

25  •  The  field  team  supervisor  or  another  technical  person  shall  review  calculations  and  inspect 

26  laboratory  logbooks  Eind  data  sheets  to  verify  accuracy,  completeness; 

27  •  Calibration  and  QC  data  will  be  examined  by  the  individual  operators  and  the  laboratory 

28  supervisor; 

29  •  Laboratory  and  project  managers  shall  verify  that  all  instrument  systems  are  in  control  and 

30  that  QA  objectives  for  accuracy,  completeness,  and  method  detection  limits  have  been  met. 

31 

32  For  the  laboratory  data, 

33 

34  •  Calibration  and  QC  data  will  be  examined  by  the  individual  analysts  and  the  laboratory 

35  supervisor; 

36  •  Laboratory  managers  shall  verify  that  all  instrument  systems  are  in  control  and  that  QA 

37  objectives  for  accuracy,  completeness,  and  method  detection  limits  have  been  met. 

38 

39  Analytical  outlier  data  are  defined  as  those  QC  data  lying  outside  a  specific  QC  objective  window 
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1  for  precision  and  accuracy  for  a  given  analytical  method.  Should  QC  data  be  outside  of  control 

2  limits: 

3 

4  •  The  analytical  laboratory  or  field  team  supervisor  will  investigate  the  cause  of  the  problem. 

5  •  If  the  problem  involves  an  analytical  problem,  the  sample  will  be  reanalyzed. 

6  •  If  the  problem  can  be  attributed  to  the  sample  matrix,  the  result  will  be  flagged  with  a  data 

7  qualifier. 

8  •  The  data  qualifier  will  be  included  and  explained  in  the  final  analytical  report. 

9 

10  6.5.3  Data  Reporting 

11 

12  This  section  contains  a  list  of  the  water  quality  and  equipment  operation  data  to  be  reported.  At  a 

13  minimum,  the  data  tabulation  shall  list  the  results  for  feed  water  and  treated  water  quality  analyses 

14  and  equipment  operating  data.  All  QC  information  such  as  calibrations,  blanks  and  reference 

15  samples  are  to  be  included  in  an  appendix.  All  raw  analytical  data  should  also  be  reported  in  an 

16  appendix.  All  data  should  be  reported  in  hardcopy  and  electronically  in  a  common  spreadsheet  or 

17  database  format 

18 

19  6.6  Calculation  of  Data  Quality  Indicators 

20 

21  The  equations  for  any  data  quality  indicator  calculations  employed  shall  be  provided.  These 

22  include:  precision,  relative  percent  deviation,  standard  deviation,  accuracy,  and  completeness. 

23 

24  6.7  System  Audits 

25 

26  On-site  system  audits  for  sampling  activities,  field  operations,  and  laboratories  shall  be  conducted 

27  as  specified  by  the  NSF  Equipment  Verification  Testing  Plan.  These  audits  will  be  performed  by 

28  the  NSF  to  determine  if  the  NSF  Equipment  Verification  Testing  Plan  is  being  implemented  as 

29  intended.  Separate  audit  reports  will  be  completed  after  the  audits  and  provided  to  the 

3 0  participating  parties  through  the  NSF . 

31 

32 

33 

34 

35 

36  6.8  Reports 

37 

38  6.8.1  Status  Reports 

39 
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equipment  testing  organization  shall  prepare  periodic  reports  for  the  NSF  project  managers 
Ihese  reports  should  discuss  project  progress,  problems  and  associated  corrective  actions,  and 
mture  scheduled  activities  associated  with  the  verification  testing.  When  problems  occur,  the 
Manufacturer  ^d  equipment  testing  organization  project  managers  shall  discuss  them  with  the 
NSF  technical  lead,  estimate  the  type  and  degree  of  impact,  and  describe  the  corrective  actions 
taken  to  mitigate  the  impact  and  to  prevent  a  recurrence  of  the  problems.  The  frequency  format 
an  content  of  these  reports  shall  be  outlined  in  the  Manufacturer  Field  Operations  Document. 

6.8.2  Audit  Reports 


Any  QA  audits  or  inspections  that  take  place  in  the  field  or  at  the  analytical  laboratoiy  while  the 
venfication  testing  is  being  conducted  shall  be  formally  reported  by  the  equipment  testing 
organizations  to  the  NSF  project  manager  who  will  forward  them  to  the  Manufacturer  and  NSF 
QC  Manager  for  appropriate  actions. 


6.9  Corrective  Action 


Each  Manufacturer  Field  Operations  Document  must  incorporate  a  corrective  action  plan.  This 
plm  must  include  the  predetermined  acceptance  limits,  the  corrective  action  to  be  initiated 
whenever  such  acceptance  criteria  are  not  met,  and  the  names  of  the  individuals  responsible  for 


Routine  corrective  action  may  result  from  common  monitoring  activities  such  as- 

•  Performance  evaluation  audits 

•  Technical  systems  audits 


Content  of  Manufacturer  Field  Operations  Document  Regarding  Quality  Assurance 
rroject  Plan: 


The  Manufacturer  shall  be  responsible  for  including  the  following  elements 
Field  Operations  Document: 


in  the  Manufacturer 


•  Description  of  methodology  for  measurement  of  accuracy. 

•  Description  of  methodology  for  measurement  of precision. 

Description  of  the  methodology  adopted  for  use  of  blanks,  the  materials  used  in  the  blanks, 

t  e  frequency  for  using  blanks,  the  criteria  for  accepting  blanks  and  the  actions  which  will  be 
taken  if  these  criteria  are  not  met. 

Description  of  any  specific  procedures  appropriate  to  the  analysis  of  the  PE  samples  It  has 
to  be  clear  how  these  samples  are  going  to  be  used  in  the  verification  testing.  One  use  of  PE 

ThisOm// Protocol  ofNovember  8, 1996  may  not  be  duplicated  in  whole  orin  part  without  the  written  pennission  ofNSF  International 


Page  31 


1  samples  is  in  the  conduct  of  a  system  audit  (see  Section  6. 7). 

2  •  Outline  of  the  procedure  for  determining  samples  to  be  analyzed  in  duplicate,  the  frequency 

3  for  performing  duplicate  analyses  and  approximate  number  of  samples  which  will  be 

4  included  in  this  program. 

5  •  Description  of  the  procedures  used  to  assure  that  the  data  are  correct. 

6  •  Listing  of  equations  used  for  any  necessary  data  quality  indicator  calculations .  These 

1  include:  precision,  relative  percent  deviation,  standard  deviation,  accuracy,  and 

8  completeness. 

9  •  Outline  of  the  frequency,  format,  and  content  of  reports  to  be  submitted  to  each  party 

10  involved  in  the  tests. 

11  •  Description  of  the  action  which  will  be  used  to  correct  problems  as  they  occur  during  the 

12  tests. 

13 

14  Manufacturer  Responsibilities: 

15 

16  •  Provision  of  all  QC  information  such  as  calibrations,  blanks  and  reference  samples  in  an 

17  appendix.  All  raw  analytical  data  should  also  be  reported  in  an  appendix. 

18  •  Provision  of  all  data  in  hardcopy  and  electronic  form  in  a  common  spreadsheet  or  database 

19  format. 

20 
21 
22 
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1  7.0  DATA  MANAGEMENT  AND  ANALYSIS,  AND  REPORTING 

2 

3  7.1  Data  Management  and  Analysis 

4 

5  The  Manufacturer,  the  qualified  testing  organization  and  the  NSF  each  have  distinct 

6  responsibilities  for  managing  and  analyzing  verification  testing  data.  The  equipment  testing 

7  organization  is  responsible  for  managing  all  the  data  and  information  generated  during  the 

8  verification  testing.  The  Manufacturer  is  responsible  for  furnishing  those  records  generated  by  the 

9  equipment  testing  organization.  The  NSF  will  be  responsible  for  analysis  and  verification  of  the 

10  data 

11 

12  A  variety  of  data  will  be  generated  during  a  verification  testing.  Each  piece  of  data  or  information 

1 3  identified  for  collection  in  the  NSF  Equipment  Verification  Testing  Plan  will  need  to  be  provided 

14  to  the  NSF.  The  data  management  section  of  the  Manufacturer  Field  Operations  Document 

1 5  should  describe  what  types  of  data  and  information  needs  to  be  collected  and  managed.  It  should 

1 6  also  describe  how  the  data  will  be  reported  to  the  NSF  for  evaluation. 

17 

1 8  Laboratory  Analyses:  The  raw  data  and  the  validated  data  must  be  provided  to  the  NSF.  These 

19  data  should  be  provided  in  hard  copy  and  in  electronic  format.  As  with  the  data  generated  by  the 

20  innovative  equipment,  the  electronic  copy  of  the  laboratory  data  should  be  provided  in  either  a 

21  spreadsheet  or  a  database  format,  and  a  data  dictionary  should  be  provided.  In  addition,  all 

22  QA/QC  summary  forms  must  be  provided  in  a  hardcopy  format. 

23 

24  Other  items  that  must  be  provided  include: 

25  •  field  notebooks; 

26  •  photographs,  slides  and  videotapes  (copies); 

27  •  results  from  the  use  of  other  field  analytical  methods; 

28 

29  7.2  Report  of  Equipment  Testing 

30 

3 1  The  qualified  testing  organization  shall  prepare  a  draft  report  describing  the  verification  testing 

32  that  was  carried  out  and  the  results  of  that  testing.  This  report  shall  include  the  following  topics: 

33 

34  •  Introduction 

35 

36  •  Executive  Summary 

37 

38  •  Description  and  Identification  of  Product  Tested 

39 
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6 
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8 
9 

10 

11 

12 

13 

14 

15 

16 

17 

18 

19 

20 
21 
22 

23 

24 

25 

26 
27 


•  Procedures  and  Methods  Used  in  Testing 

•  Results  and  Discussion 

•  Conclusions  and  Recommendations 

•  References 

•  Appendices 

•  Manufacturer  Field  Operations  Document 

•  QA/AC  Results 

The  NSF  will  review  the  draft  report,  the  results  of  testing,  the  QA/QC  results,  and  will  prepare  a 
final  report. 


Content  of  Manufacturer  Field  Operations  Document  Regarding  Data  Management  and 
Analysis,  and  Reporting: 

The  Manufacturer  shall  be  responsible  for  including  the  following  elements  in  the  Manufacturer 
Field  Operations  Document: 

•  Description  of  what  types  of  data  and  information  needs  to  be  collected  and  managed. 

•  Description  of  how  the  data  will  be  reported  to  the  NSF  for  evaluation. 
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1  8.0  SAFETY  AND  ENVIRONMENTAL  MEASURES 

2 

3  The  testing  organization  shall  prepare  a  document  identifying  the  safety  procedures  that  shall  be 

4  used  during  the  field  work.  The  safety  considerations  addressed  in  this  document  will  include  the 

5  following  as  applicable: 

6 

7  •  conformance  with  electrical  and  plumbing  codes  applicable  at  the  test  site(s); 

8 

9  •  arsenic  handling  procedures  (if  spiking  tests  are  to  be  performed)  and  disposal  of  wastes 

10  containing  arsenic; 

11 

12  •  ventilation  of  equipment  or  of  trailers  or  buildings  housing  equipment,  if  there  are  gases 

1 3  generated  by  the  equipment  that  could  present  a  safety  hazard  (one  example  is  the  use  of 

14  ozone). 

15 

16  Content  of  Manufacturer  Field  Operations  Document  Regarding  Safety: 

17 

1 8  The  Manufacturer  Field  Operations  Document  shall  address  safety  and  environmental 

19  considerations  that  are  appropriate  for  the  equipment  being  tested. 
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